bot utterance
Improving Bot Response Contradiction Detection via Utterance Rewriting
Jin, Di, Liu, Sijia, Liu, Yang, Hakkani-Tur, Dilek
Though chatbots based on large neural models can often produce fluent responses in open domain conversations, one salient error type is contradiction or inconsistency with the preceding conversation turns. Previous work has treated contradiction detection in bot responses as a task similar to natural language inference, e.g., detect the contradiction between a pair of bot utterances. However, utterances in conversations may contain co-references or ellipsis, and using these utterances as is may not always be sufficient for identifying contradictions. This work aims to improve the contradiction detection via rewriting all bot utterances to restore antecedents and ellipsis. We curated a new dataset for utterance rewriting and built a rewriting model on it. We empirically demonstrate that this model can produce satisfactory rewrites to make bot utterances more complete. Furthermore, using rewritten utterances improves contradiction detection performance significantly, e.g., the AUPR and joint accuracy scores (detecting contradiction along with evidence) increase by 6.5% and 4.5% (absolute increase), respectively.
Neural Generation Meets Real People: Towards Emotionally Engaging Mixed-Initiative Conversations
Paranjape, Ashwin, See, Abigail, Kenealy, Kathleen, Li, Haojun, Hardy, Amelia, Qi, Peng, Sadagopan, Kaushik Ram, Phu, Nguyet Minh, Soylu, Dilara, Manning, Christopher D.
Building an open-domain socialbot that talks to real people is challenging - such a system must meet multiple user expectations such as broad world knowledge, conversational style, and emotional connection. Our socialbot engages users on their terms - prioritizing their interests, feelings and autonomy. As a result, our socialbot provides a responsive, personalized user experience, capable of talking knowledgeably about a wide variety of topics, as well as chatting empathetically about ordinary life. Neural generation plays a key role in achieving these goals, providing the backbone for our conversational and emotional tone. At the end of the competition, Chirpy Cardinal progressed to the finals with an average rating of 3.6/5.0,
Why did your chatbot fail miserably ?
Neo is a talented developer who loves building stuff. One fine morning, Neo decides to take up a road, less travelled, decides to build a chatbot! After a couple of keyword searches and skimming through dozens of articles with titles "build a chatbot in 5 mins", "chatbot from scratch" etc, Neo figures out the basic components to be intent detection, Named Entity Recognition,Text Matching for QnA . Another 30 mins of Google search and Neo has collected his arsenal, the state of the art implementations for these 3 components. His arsenal has the almighty Bert for NER, Ulmfit for Text classification, RoBERTa for text matching.